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^ I Abstract 

' The recent theory of sequential games and selection functions by Mar- 

tin Escardo and Paulo Oliva is extended to games in which players move 
simultaneously. The Nash existence theorem for mixed-strategy equilibria 
of finite games is generalised to games defined by selection functions. A 
normal form construction is given which generalises the game-theoretic 
normal form, and its soundness is proven. Minimax strategies also gener- 
alise to the new class of games and are computed by the Berardi-Bezem- 
Coquand functional, studied in proof theory as an interpretation of the 
axiom of countable choice. 
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1 Introduction 



^ . The notion of optimisation is common to many areas of applied mathematics, 

' such as game theory and linear and nonlinear programming. Typically we have 

a set X of choices and a function p mapping each x G X to a, real number p{x), 
which we might call the value or cost of x. From this we can define a natural 
notion of optimality: a point y G M is optimal just if y > p{x) for all x G X and 
y = p{xq) for some xq G X. We usually refer to y by a notation such as 



y = maxp(x) 

The point xq is also interesting: it is a point at which p attains its optimal 
value, and we refer to it as 



jrt , Xq = argmaxp(x) 

■ - - x£X 

(Of course, while y is guaranteed to be unique when it exists, xq is not neces- 
sarily unique; we only require that argmax chooses some value for xq-) These 
notations are connected by the equation y = p{xo), or 



maxp(x) —p argmaxp(a;) 

Suppose we fix the set X and assume that maxxizx p{x) exists for all func- 
tions p : X ^ M. {as when X is finite, for example). We can now define a 
function by 

(p{p) = maxp{x) 
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(fi has range K, and its domain is the function set X — !■ R, that is, the set of ah 
functions with domain X and range R. We therefore write 

We call if a higher-order function, that is, a function whose domain is itself a 
set of functions. We can also define 

e(j)) — argmaxp(a;) 
xex 

obtaining a higher-order function 

e: {X ^R) ^ X 

satisfying 

ip{p) = pie{p)) for all p : X -J> R 

Using the concept of a higher-order function we can make a large generali- 
sation of the properties of max and arg max. For any sets X and R, a function 
if : {X i?) — > i? will be called a quantifier and a function e : {X ^ R) ^ X 
will be called a selection function. We say that e attains ip just if Lp{p) — p{e{p)) 
for all p : X ^ R. max and arg max become the prototypical examples of a 
quantifier and a selection function attaining it. A very different example of a 
quantifier is a fixed point operator ^ : (X — > X) X which has the prop- 
erty that ^(p) is always a fixed point of p, that is, = p{^{p)). Thus a 
fixed point operator attains itself. Quantifiers where R is the set of truth- values 
appear naturally in logic. These concepts were introduced and applied to the 
theory of sequential g ames by Martin Escardo and Paulo Oliva in a series of 



papers summarised in (jEscardo and Qlivall201lh 



What is a game? Typically, some players take turns choosing between sets 
of legal moves, which may be constrained by previous players' moves. The 
sequence of moves made by the players is called a play of the game. Usually, 
the rules of the game guarantee that every play terminates after a finite number 
of moves, and then uniquely determine which player has won the play. 



In the theory of games as introduced by l|von Neumann and Morgenstern 



1944 ) the notion of a player winning a play is not used. Rather, for each player 
the rules of the game define an outcome function mapping each play of the game 
to a real number called the utility of the play for that player. This generalisation 
is important for applications of game theory to economics, where utility often 
represents profit. In the game played by two competing firms, for example, 
each firm is interested in maximising its own profit, and does not care (in the 
short term, at least) how much profit its competitor makes. Of course, a firm's 
profits will be affected by the moves of its competitor, and vice versa. A central 
problem of game theory is to determine which moves each player should choose 
in order to maximise their utili ty. The theory of games as surveyed for example 
in (jPudenberg and Tirolelll99lh ' will be referred to as classical game theory. 



Suppose during the course of a play some player must choose between some 
set X of moves. Taking the usual assumption of common knowledge of ratio- 
nality (that is, the players play optimally, and they know that each other will 
play optimally, and so on) the future of the play after making each choice of 
a; € A" is sufficiently well determined that a utility p{x) G R can be assigned 
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to each x G X. In classical game theory, a rational player will always choose 
argmax^gj(-p(x). By replacing R with an arbitrary set R and argmax with an 
arbitrary selection function e : {X ^ R) —i' X, a. rich theory of generalised 
games r esults, with deep connections to proof theory a nd theoretical computer 
science (|Escard6 and OhvallioiObl. lEscardo et al.ll201l[ ). 

The games which have been described so far are the so-called sequential 
games. In the more usual language of classical game theory this can be read as 
non-branching extensive form games of perfect information. However there are 
games which cannot be described as a sequence of moves. These are the so-called 
simultaneous games, or games of imperfect information. A well known example 
is rock-paper-scissors; a more important example is the simultaneous pricing of 
goods by supermarkets, von Neumann and Morgenstern proved that every game 
can be described as a simultaneous game, called its normal or strategic form. 
The central idea of this proof is that players simultaneously choose contingent 
strategies, higher-order functions which choose the next move given the play up 
to that point, and so play the game on behalf of the player. In this paper we 
consider a notion of simultaneous games that encompasses Escardo and Oliva's 
generalised sequential games in a similar way. 

In section 3, generalised simultaneous games and their appropriate notion of 
equilibrium are defined. In section 4 a class of games, the so-called multilinear 
games, is defined, and it is proven that games of this kind always have an 
equilibrium (theorem [5]). This is used in section 5 to prove the key result of this 
paper (theorem ^ , a natural generalisation of Nash's theorem for the existence 
of mixed-strategy equilibria to games defined by arbitrary quantifiers. In section 
6 a mapping from sequential to simultaneous games is defined analagous to the 
normal form construction in the classical theory, and its soundness is proven 
(theorem [5]). In section 7 we show an interesting connection to proof theory, 
namely that the binary Barardi-Bezem-Coquand functional computes minimax 
strategies of games, a result that suggests a deeper connection between proof 
theory and generalised games. 



2 Preliminaries 

If X and Y are sets then X ^ Y denotes the set of all functions with domain 
X and range Y (this is often denoted Y^ , a notation we avoid in order to avoid 
writing exponential towers for higher-order functions). Cartesian products of 
sets are denoted Y[ and bind tighter then — so for example Yiiei Xi ^ R 
means (Ilie/ ^i) ^ ^- The ith coordinate projection of a tuple tt € Yiiei 
denoted tt^. 

The following piece of notation, for manipulating products, will be helpful. 
Let / be a set and let Xi be a set for each i e /. U x E Xi and tt S Hje/ -^J 
then we define 7r(z i-^ x) € Yijei -^j t'Y 



{TT{i h-> X))j 



X ii i — j 
TTo otherwise 



We make use of Church's A-notation for describing functions anonymously. 
The function which might otherwise be written as x t-^ 1 + x will be denoted 
Aa:^.l -|- X, where N is the domain of the anonymous function. For example we 
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have (Aa:^.l + a:) (42) = 43. A variable bound by a A need not appear under the 
scope of the A, for example Ax'''". 42 is the constant function with the property 
that (Aa;^.42)(x') = 42 for ah x' G X. 

A quantifier is a func tion (p £ SrIX) where S piX) = (X — s> i?) — s> 'P{R), a 
definition introduced in ( Escardo and Oliva 1201 ih . The domain of a quantifier 



dom{ip) = {pe X ^ R \ Lp{p) 7^ 0} 

A quantifier with dom(c/3) = A — > i? will be called total. 

A selection function is a function e £ Jr(X ) where Jb.(X) = (A — > i? ) — > A. 
Selection functions were first introduced in ( Escardo and Clival l2010al ). The 



quantifier Lp G Sr{X) is attained by the selection function e G Jji{X) just if 

G (^(p) 

for all p G dom((p). This definition of attainment differs from Escardo and 
Oliva's, who require the condition to hold for all p G A ^> _R. For a total 
quantifier (which are considered in section 5, and to which the main theorem 
applies) the two definitions coincide. 

For example, if i? = R and A is compact then the extreme value theorem 
(plus the axiom of choice) implies that the maximum quantifier 



{maxj;gxp(a;)} if p is continuous 
otherwise 



is attained. (Note that we need the axiom of choice to collect all the values into 
a single function.) A quantifier such as this whose values have cardinality at 
most 1 will be called single-valued. Since the definition of is clumsy we can 
use a new notation for single- valued quantifiers, such as 



(/3(p) ~ maxp(a;) 



p is continuous 



We assume some point-set topology as covered, for example, in jKellevlll955l ) 



and elementary properties of topological vector spaces ( Conwavlll990 ). All topo- 
logical vector spaces are assumed to be Ti throughout (this is no loss of general- 
ity because quotienting a topological vector space by the closure of {0} always 
yields a Hausdorff space). For reference, a subset 5 of a real vector space is 
called convex iff for all x,y € S and t G [0, 1] we have tx + {1 — t)y G S. 

In part 4 we work with the class of locally convex spaces. The definition of 
a locally convex space is technical and not necessary for our purposes; beyond 
theorem[T]and lemma[5]we only need to know that every locally convex space is a 
topological vector space. Every normed vector space is locally convex; examples 
of locally convex spaces which are not normable include the spaces of smooth 
functions C°°(M) and C°°{[0, 1]) and the space of real- valued sequences with 
convergence de fined pointwise. Locally convex spaces are covered in detail in 
(|Conwavlll99"nh . 



A note on foundations. It is possible to define generalised sequential 
games over models other than classical set theory. Indeed, as explained in 



([Escardo and Olival 120111 ) it is sometimes necessary to work in nonstandard 
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models, for example when considering unbounded sequential games (whieh are 
not considered in this paper). Jn is a (strong) monad and can be defined over 
any cartesian closed category (moreover the closely related Kji{X) = (X — )• 
R) — > R, which contains the total single-valued quantifiers, is already well- 
known from programming language theory where it is called the continuation 
monad). The definitions of generalised simultaneous game and abstract Nash 
equilibrium could be formalised in a more general setting, but the proofs in 
section 4 use classical set theory in an essential way, so we find it easier to avoid 
foundational issues altogether and work entirely in classical set theory. 

3 Generalised simultaneous games 

In this section we define the objects studied in this paper, namely generalised 
simultaneous gam,es and generalised Nash equilibria. The definition of a gener- 
alised simultaneous game comes from the classical definition of a normal-form 
game, but with the maximising behaviour of players replaced with a specified 
qiiantifier. For the general definition we do not require the mimber of players 
to be finite. The related notion of generalised sequential game will be defined 
in section 6. 

Definition 1 (Generalised simultanous game). A generalised simultaneous game 
(with multiple outcome spaces), denoted simply game when not ambiguous, is a 
tuple 

S = (I, i^i, Ri,qi,'^i)iei) 

where I is a nonempty set of players, and for each i € I, 

• Xi is a nonempty set of moves for player i; 

• Ri is a set of outcomes for player i; 

• Qi € S ^ Ri is the outcome function for player i, where S = Yijei -^i *^ 
the strategy space of Q; 

• ipi G Sii,.{Xi) is the quantifier for player i. 

We say that Q has a single outcome space if the Ri are equal and the qi are 
equal. In this case Q is determined by a tuple 

= {I, {Xi)iei, R, q, {iPi)iei) 

where q G S ^ R. 

An element x & Xi is called a strategy for player i for Q. A tuple w € S is 
called a strategy profile for Q. Throughout this paper the variables n, a and r 

will range over strategies of a game. 

In general we need games with multiple outcome spaces to study simulta- 
neous games, and in particular to recover the classical Nash theorem. However 
normal forms of generalised sequential games will always have single outcome 
space. 

The appropriate notion of equilibrium of a generalised simultaneous game 

is called a generalised Nash equilibrium. Before making this definition, we first 
define some notation used throughout this paper. Firstly we define the family of 
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unilateral m,aps U^, which arc used as a shorthand notation but, when considered 
as a higher-order functions, are also natural and interesting in their own right. 

Definition 2 (Unilateral map) . Let I be a set, and for each i G I let Xi and 
Ri be sets. Let q = {qi)i^i be a family of maps such that each 

ft 6 n ^ 

We define the ith unilateral map 

UgeHXj ^{Xi^ Ri) 

by 

Ui{w){x) = qi{TT{i H- x)) 

Thus, the ith unilateral map computes the; outcomes of imilateral changes of 
strategy by the ith player in a game. Secondly, we associate to every quantifier 
a set called its diagonal. 

Definition 3 (Diagonal of a quantifier). Let ip G Sr{X) be a quantifier. The 
diagonal of (fi is 

A{v) = {{p, x)e{x^R)xX\ p{x) e ^{p)} 

Now the equilibria of a generalised simultaneous game can be defined in a 
very compact and (as will be seen) useful way. 

Definition 4 (Generalised Nash equilibrium). Let Q be a game with strategy 
space S. We define the best response correspondence B G S ^(5') of G by 



where the Bi G S ^ are defined by 

Bi{'K) = {cjeS\{Ui(TT),ai)eA{^i)] 

A generalised Nash equilibrium of Q is a fixed point of B, that is, a strategy 
profile TT such that tt G B{'k). 

Unpacking this definition, we see that tt is a generalised Nash equilibrium of 
Q iff for each i £ I we have 

qiin) G ipi{Xx^\qi{T:{i i-> x))) 

When Xi is compact, qi is continuous and (fi is the quantifier 



(fii{p) = maxp(.T) 



p is continuous 



this reduces to 



qiiji) = maxq.,{iT{i ^ x)) 
which is the usual definition of a Nash equilibrium. 
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4 Multilinear games 

Now we define a large family of games, called the multilinear games, that are 
guaranteed to have a generalise d Nash eq uilibrium. The structure of the ar- 



gument is the same as that in (jNashrnQSOM . but given in more generality to 



deal with more general quantifiers. This section can be seen as a series of lem- 
mas that are eventually used to prove theorem |3] (the generalisation of Nash's 
theorem) in the next section. 

Definition 5 (Closed graph property). Let X and Y he topological spaces and 
F ^ X ^ V{Y). We say that F has the closed graph property iff 

T{F)^{{x,y)eXxY\yeF{x)} 

is closed with respect to the product topology. 

The closed graph property is a form of continuity for functions whose range 
is a set of subsets of a topological space. 

In order to guarantee that a generalised simultaneous game will have an 
equilibrium we need to impose closed graph properties on the quantifiers. How- 
ever the domain of a quantifier is a function set, which in general has no unique 
natural topology. The least we need is that the unilateral maps are continuous, 
and so for this reason we define the unilateral topology. 

Definition 6 (Unilateral topology) . For each i G I let X, and Ri he topological 
spaces with qi d Xi ^ Ri continuous. The unilateral topology on Xi — Ri is 
the final topology with respect to the singleton family {lA^}, that is, it is the largest 
topology with respect to which is continuous. A function which is continuous 
with respect to the unilateral topology will he called unilaterally continuous, and 
a function which has closed graph with respect to the unilateral topology has 
unilaterally closed graph. 

Another possible topology on Xi — > Ri which will be useful is the topology 
of pointwise convergence. Most of this paper could be formulated using only 
pointwise convergence, except for an interesting example at the end of this 
section which needs a finer topology, namely uniform convergence. 

Lemma 1. The unilateral topology is finer than the topology of pointwise con- 
vergence. 

Proof. It must be proven that is continuous with respect to the topology of 
pointwise convergence. Let tTj — > tt be a convergent sequence in 11 je/ -^j^ ^^'^ 
let X € Xi. We have 

■nj{i H> x) — > Tr{i i— x) 

in the product topology, so 

Ul{'Kj){x) = q^{■nj{^ ^ x)) — > q,{Tr{i x)) = ^(7r)(a;) 

because qi is continuous. Therefore UqiiTj) — > U'^qij^) pointwise, as required. □ 

Now we can give the definition of a multilinear game. This definition essen- 
tially contains the least assumptions needed for Nash's proof. 
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Definition 7 (Multilinear game). A game Q — {I,{Xi,Ri,qi,(pi)i(zj) is called 
multilinear iff 

• Each Xi is a compact and convex subset of a given locally compact space 
Vi over R; 

• Each Ri is a topological vector space over R; 

• Each qi extends to a continuous multilinear map 

9» e n ^ 

(that is. qi is linear with respsect to each Vj separately); 

• Each ipi has unilaterally closed graph, ipi{p) is closed and convex for all 
p Xi ^ Ri, and dom{ipi) D im(i^*). 

(Note that because qi is continuous and multilinear, to satisfy the last con- 
dition it suffices that ipi{p) ^ whenever p is continuous and linear. Note also 
that if ifi is single- valued then each ipi{p) is automatically closed and convex.) 

The idea of the existence proof is to reduce to the following fixed point 
theorem. 

Theo rem 1 (Kakutani-Fan-Glicksberg fixed point theorem ( Fanlll952ilGlicksberg| 



19521)). Let S be a nonempty, compact and convex subset of a locally convex 



space over K. Let i? g 5 —> V{S) have closed graph and let B{t:) he nonempty, 
closed and convex for all t: d S . Then B has a fixed point. 

We will need to use the fact that locally convex spaces are closed under 
arbitrary products. 

Lemma 2. Let {Vi}i^i be a family of locally convex spaces over a field K . Then 
Wi^j Xi has the strucutre of a locally convex space over K whose topology is the 
product topology. 

Much of the usefulness of multilinear games comes down to the fact that 
their unilateral maps are well-behaved. 

Lemma 3. Let Q he a multilinear game with strategy space S . Then each is 
a continuous function 

WgeS xX,~^ R, 

(under the Curry bisection A^{B^C) = AxB^C) which is linear in its 
second argument. 

Proof. By the continuity and multilinearity of the qi. □ 

Lemmas |4][8] form the core of the proof, establishing the hypotheses of the 
Kakutani-Glicksberg-Fan theorem. 

Lemma 4. Let Q he a multilinear game. Then the strategy space of Q is a 
nonempty, compact and convex subset of a locally convex space. 
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Proof. The strategy space is 

where the larger space is locaUy convex by lemma [5] 

S is nonempty by the axiom of choice and compact by Tychonoff 's theorem. 
Convexivity is also inherited by the product, since for each i € I we have 

(tx + (1 - t)y), = tx^ + (1 - t)yi eXi □ 

Lemma 5. Let Q be a multilinear game with best response correspondence B 
such that each quantifier ipi is attained by a selection function e^. Then B^n) 
is nonempty for all tt. 

Proof. Let S be the strategy space of Q. Given vr G 5* we define ct £ 5* to have 
ith component 

Since Si attains (pi and W*(7r) e dom(ipi) we have 
Therefore 

(W;(7r),a,) = (W^W,£.(iY;(7r))) e A(^0 
so a € B^n), as required. □ 

Lemma 6. Let Q be a multilinear game with best response correspondence B. 
Then B{tt) is closed for all tt. 

Proof. It suffices to prove that each factor 

B,{n) ^ {a e S \ {U^i7r),a,) € A{^,)} 

is closed. Let aj — > cr be a convergent sequence in _Bj(7r). For each i we have 
cTj.i — > ai, so 

by the continuity of U^. We also have that each 

and the right hand side is closed by definition, therefore 

that is, 

£ A(^,) □ 

Lemma 7. Let Q be a multilinear game with best response correspondence B. 
Then B{tt) is convex for all tt. 
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Proof. Suppose ct, r 6 B{'!t) and t G [0, 1]. Let i E I. By definition we have 

^(7r)(a,),^(7r)(r,) G V^.^W) 
Since the linearity of iY* we have 

+ (1 - t)n) = tUl{n){a,) + (1 - t)^(7r)(T,) 
Since the ^Pi{p) are convex, we have 

Z^^(7r)(to, + (l-0r,)ev'.KW) 

that is, 

+ (l-t)r,)G A(^0 

Therefore 

iff + (1 - t)T e B(7r) □ 

Lemma 8. Let Q he a multilinear game with best response correspondence B. 
Then B has closed graph. 

Proof. Note that 

lei 

and so it suffices to prove these factors closed. Let {aj,TTj) — 5- (cr, tt) be a 
convergent sequence in the ith factor. By the continuity of iY*, 

Since lA^ is also unilaterally continuous as a map S — > {Xi Ri), we have 
^qi'^j) — ^ ^g(^) unilaterally. Therefore we have a convergent sequence 

in the graph T{ipi), which is closed by definition. □ 

Theorem 2 (Existence theorem for multilinear games). Let Q be a multilinear 
game such that each quantifier is attained by a selection function. Then Q has 
a generalised Nash equilibrium. 

Proof. Let B be the best response correspondence of Q. By lemmas |4][8] and the 
Kakutani-Fan-Glicksberg fixed point theorem, B a fixed point. □ 

Examples of multilinear games as mixed extensions of finite games are given 
in the next section. Another interesting example is given by integration. Let 
Xi = [0,1], Vi = R and Ri = R, and let L{Xi) be the set of all Lebesgue- 
integrable functions p G [0, 1] — R with 



1 

p{x) dx 



< oo 
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Define a single- valued quantifier ipi G Sg^Xi by 

fi{p) = / P{x) dx 



peL{x,) 

Using the mean value theorem (and the axiom of choice) we can prove the 
existence of a selection function attaining ipf. for all p G L{Xi) there exists 
ei{p) G Xi such that 

Pfe(p)) = / p{x)dx 
Jo 

This high ly nonconstructive selectio n function was briefly introduced as an ex- 
ample in (jEscardo and 01ivall2ninall . 

We let / be finite and for simplicity let the other Xj be normed, so the 
strategy space is normed and we can work with the e — 6 definitions of uniform 
convergence and continuity. 

Lemma 9. If Qi is uniformly continuous and nj — > tt then U^^TTj) — U^{tt) 
uniformly. 

Proof. We have that qi is uniformly continuous, that is, 

Ve > 3(5 > V7r,CT G Y[X^. |7r - cr| < ^ =^ |gi(7r) - gi(cr)| < e (1) 

We also have tTj — > tt, that is, 

Ve > 37V Vj > N. ItTj - 7r| < e (2) 

We want to prove that Uq{Tij) — > W*(7r) uniformly, that is, 

Ve > 3Ar > TV Vx G X,. \U'g{T:j){x) - U'g{7r){x)\ < e 

Let £ > 0. By (1), we have ^ > with the given property. We take e in (2) 
to be this 5, obtaining N . Let j > N, therefore 

ItTj — 7r| < (5 

by (2). Let x ^ X. The crucial observation is that TTj{i i-^ x) behaves like ttj 
but is constant in its ith coordinate. That is, we have 

|7rj(i 1-^ x) ~ ■n{i ^ x)\ < IvTj — vrj < (5 

Now we take tt, a in (1) to be Trj{i i-^> x) and 7r(i t-^ x). We have already 
proved the antecedent in (1), therefore 

-^(7r)(a;)| = \q,{7rj{i ^ x)) - q^{TT{i ^ x))\ < e 

as required. □ 

We have proven that the unilateral topology is finer than the topology of 
uniform convergence. 

Lemma 10. (pi is unilaterally continuous. 
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Proof. Suppose wc have pj — p uniformly in L{Xi). Since the convergence of 
the integrands is uniform, we can apply the uniform convergence theorem to get 

fiiPj) = / Pj{x)dx — > I p{x) dx = (fiiip) 
Jo Jo 

Since the unilateral topology is finer than the topology of uniform convergence, 
we are done. □ 

In the 1-player game defined by the integration quantifier with outcome 
function q, the unique vahic of q{x) when x is an equilibrium strategy, which 
can be called the expected outcome of the game, is simply 



1 

q{x) dx 



In the 2-player game with both quantifiers integrals, a generalised Nash equi- 
librium (a, b) satisfies 



a= qx{x,b)dx b= qY{a,y) 
Jo Jo 



dy 



Since p{x) dx is the average value of p, this is a game where players are trying 
to gain the average outcome rather than the maximum. The existence of a Nash 
equilibrium in this case can be more directly proven by applying the Brouwer 
fixed point theorem to the mapping 



[0,1]2^ [0,1]2, (a,6)K^^ qx{x,b)dx,J^ qY{a,y) 



dy 



5 Finite games 

In this section we apply the existence theorem for multilinear games to prove 

a suitable generalisation of Nash's theorem. The classical version of Nash's 
theorem guarantees that every finite game (that is, a classical game in which 
each player has finitely many strategies) has a mixed strategy Nash equilibrium. 

The notion of mixed strategics means that wc consider probably distributions 
over ordinary strategies (referred to as pure strategies for clarity) . The outcome 
functions also need to be replaced by expected outcome functions. However 
the discussion of probability distributions can be avoided by treating them as 
geometric objects, namely simplices. This approach also makes it clearer how 
quantifiers and selection functions must be modified when passing to mixed 
strategies. A probabilistic interpretation of the resulting theorem is possible, 
but is avoided in this paper. 

Definition 8 (Finite game). A game Q = (/, {Xi, Ri, qi, ipi)i^i) is called finite 
iff 

• I is finite; 

• Each Xi is finite; 

• Each Ri is a topological vector space over M; 
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• Each ipi is total, has closed graph with respect to the topology of pointwise 
convergence, and (pi (p) is closed and convex for all p & Xi ^ Ri. 

Note that restricting to pointwise convergence is no loss of generality here 
because the Xi are finite. 

The set of probability distributions over a finite set can be seen as a geometric 
object called a standard simplex. In 2 and 3 dimensions these can be easily 
visualised as a line segment and an equilateral triangle; the next simplex A4 is 
a tetrahedron seen as a subset of M^. 

Definition 9 (Standard simplex). The nth standard simplex is the set 

n 

= {{xi,- ■ ■ , Xn) G M" I ^^Xi = 1 and each Xi > 0} 

i=l 

Definition 10 (Mixed extension). Let Q = {I,{Xi, Ri,qi,(pi)i^j) be a finite 
game with strategy space S. We define a game 

Q* = {L {x:,R,,q*,^*),ei) 
called the mixed extension of Q as follows: player i has move set 

outcome function 




and quantifier 

where Si is the canonical injection Xi ^ X* mapping each j to the vertex of 
the simplex at which the jth coordinate is 1. 

Note that the finiteness of / is used only in the well-definition of the q* : for 

the strategy space S to be finite it is necessary that I be finite, except in trivial 
cases when all but finitely many Xi are singletons. 

Definition 11 (Mixed strategy abstract Nash equilibrium). Let G be a finite 
game. A strategy profile for Q* will be called a mixed strategy profile for Q. An 
abstract Nash equilibrium of Q* will be called a mixed strategy abstract Nash 
equilibrium ofQ. 

The most important property of mixed extensions is that they are always 
multilinear. This will used to prove the generalised Nash theorem. 

Lemma 11. Let Q be a finite game. Then Q* is a multilinear game. 

Proof. Each A„ for n > is a nonempty, compact and convex subset of the 
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locally convex space M". Continuity of the q* is clear, q* is multilinear because 
— q*{Tr{i i~> cx + y)) 

iqi<y)) 





o-GS 

— cg*(7r(i > x)) + q*{'K{i H> y)) 

The are of the form fi{p'), and so are closed and convex. We note 

that ip* is total because ipi is. The graph of (p* is 

r(^*) = {{p,y) e (X* ^ i?,) X i?, I (po,5„y) e r((^,)} 

Suppose we have a convergent sequence (pj, y^) — 5- (p, y) in T{ip*). Let a; £ X, 
then 

(Pj o5^){x) =pj{6^{x)) >p{S^{x)) = {poS^){x) 

Therefore pj o — > p o 5i pointwise, so 

{Pj °Si,yj) — > {poS,,y) 

with respect to the topology of pointwise convergence. Since the unilateral 
topology is finer than the topology of pointwise convergence, we are done. □ 

The final result we need is the ability to lift selection functions to mixed 
extensions. 

Lemma 12. Let X be a nonempty finite set and let ip € S^X be a total quan- 
tifier attained by the selection function e G Jr^. Then there exists a selection 
function e* such that p* is attained by e* . 

Proof. We define e* G JrA|x| by the equation 

e*{p)^5{e{po5)) 

where 5 : X ^\x\- Then 

P{£*{p)) = {P° i'){£{p° t-)) e p{poL) = p*{p) 

for allp e A|^| ^R. □ 

Theorem 3 (Existence theorem for finite games) . Let Q be a finite game such 
that each pi is attained by a selection function. Then Q has a mixed strategy 
abstract Nash equilibrium. 

Proof. Q* is a multilinear game which is attained by selection functions by 
lemmas [TT] and [T^ Therefore Q* has an abstract Nash equilibrium by theorem 

m □ 
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6 THE NORMAL FORM OF A SEQUENTIAL GAME 



In order to recover the classical Nash theorem we simply consider finite 
games whose outcome spaces are M and define gi(7r) S M to be the utility of tt 
for player i, taking all quantifiers to be max. We could instead define a finite 
game with single outcome space M" and let {q{TT))i be the utility of tt for player 
i, and consider selection functions Si € Ju^Xi maximising the ith coordinate: 



However the quantifiers attained by these quantifiers are continuous only if 

n = 1. This game has the same equilibria as the equivalent game with multiple 
outcome spaces, but the Nash theorem cannot be proven in this way. It is for 
this reason that we need to consider games with multiple outcome spaces, in 
contrast to generalised sequential games (which do not require continuity). 

For a different example of a quantifier in a finite game, let Ri be normed 
and fix £ > and xo e Xj. Define 



that is, the closed e-ball around p{xo). This quantifier is attained by the constant 
selection function e(p) — xq- For a sequential game this would force the game 
to be trivial, but this is not the case here: for example, if (fx is the quantifier 
defined here and (py is the maximum quantifier with Ry = M then a Nash 
equilibrium is a point (a, b) such that 



6 The normal form of a sequential game 

In classical game theory every game can be put into the form of a simultaneous 

game called its normal form. The major motivation for dcfinining generalised 
simultaneous games was to generalise this operation to give a notion of normal 
form for generalised sequential games. This construction is given in this section 
and a form of soundness of proven, namely that the solution concept for a 
generalised sequential game, the so-called optimal strategies, are mapped to 
generalised Nash equilibria. 

Definition 12 (Generalised sequential game). A generalised sequential game 

is determined by a set R of outcomes, a set Xi of moves and a quantifier 
Vi G SfiXi for each 1 < i < n, and an outcome function q G YVi=i Xi ^ R. A 
strategy in a sequential game is a tuple 



Si{p) = argmax(p(a;))i 



ipi{p) = Bs{p{xo)) 



qx{a,b) - qx{xo,b)\ < s 



qy{a,b) = ma.xqy{a,y) 





where 



6; = 7r,(a,6^... 
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6 THE NORMAL FORM OF A SEQUENTIAL GAME 



Given a strategy n in a game, its strategic play is G Y\i=i -^i given by 



ttJ = TTi {modulo the isomorphism JJ^ Xj — > Xi — {0} — > Xi = Xi) 

ttJ+i = 7r,+i(7r|,...,7r|) 
The strategic play of an optimal strategy is called an optimal play. 

To be precise, this noti on of sequential game is called a finite game with mul- 



tiple optimal outcomes in (jEscardo and O liva 2011). Infinite games are avoided 
in this paper for simplicity. 

Generalised sequential games were introduced in order to study a particu- 
lar higher-order function called the product of selection functions. This is the 
function 

(g> e JbX X JrY Jr{X X Y) 



given by 
where 



{e(i)5){q) = {a,ba) 



a = s{Xx .q{x,bx)) br^ ^ 5{\y .qix.y)) 



The product of selection functions has many interesting and unintuitive proper- 
ties, especially when infinitely iterated: for example, it computes witnesses for 
the axiom of countable choice, and computes exha ustive searches of certain infi- 
nite types in finite time ( Escardo and Olivall2010b ). both of which popular belief 



would have is impossible. Every use of the product of selection functions can be 
seen as the compution of an optimal play for a suitable generalised sequential 
game. 

Theorem 4. Let Q be a generalised sequential game whose quantifiers are total 
and attained by selection functions Si G JrXi. Then 




is an optimal play for Q . 

Now we give the normal form construction and prove that it maps optimal 
strategies to generalised Nash equilibria. 

Definition 13 (Normal form). Let Q be a generalised sequential game. We 
define a simultaneous game with single outcome space 

= il\ixj),^j,R,q\i^l),ei) 
called the normal form of Q as follows: 
. ^{l,...,n}; 

• Each xj ^P^^ X, where Pi = 0^=1 Xj; 

• q^T^) = 9(71"^); 
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6 THE NORMAL FORM OF A SEQUENTIAL GAME 



• Each (pl{p) = ipi{Xx^^ .p{\a^\x)) . 

Theorem 5. Let Q be a sequential game and let tt be an optimal strategy for 
Q. Then tt is a generalised Nash equilibrium of . 

Proof. Let 1 < i < n. It must be proven that 

Let a = {TT^jZ^W G 11}=! -^j- Since tt is an optimal strategy for Q we have 

qia, bf, ...,bf,)e (^,(Ax^'.g(a, x, bf:,\, . . . , 6^)) 
By induction on j we have 

5f = ^,(a,5f,...,6f_i) = ^,(^I 

therefore 



qH7r)^q{7r^)^q{d,bl...,b^J 



We also have 

= (pi{Xx^\q^TT{i Xa^'.x))) 
= ^.(A:r^'.(7(r^)) 



(definition of cpl) 
(definition of U^^ ) 
(definition of q^) 



where t = 7r(i n- Acr^' .x). By induction on j we have 



if 1 < j < i 
if i = j 

/+i,--->^l-i) iii<j<n 



We certainly have that coincides with (a, a;, b'^^i , . . . , 6"^'"^) at indices I < j < i- 
Moreover by induction on i < j < n we have 



TTj (a, 5-^1 , . . . , 6 -1 J = TTj (a, r^'+i ' ■ 



therefore 



(a,x,6^4fi,...,6r) 



We have therefore proven 



q\n)e^liU;,{n)) 



that is, 



□ 



The converse is false because optimal strategies of sequential games gener- 
alise the classical notion of subgame-perfect equilibrium, which is a stronger 
condition than classica l Nash equilibrium (calle d an equilibrium refinement in 
classical game theory) (jEscardo and Olivall2012l) . 
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7 2-player games and minimax strategies 

In this section the abstract notion of a ^'-f strategy is defined, and used to show 
an intriguing connection between generaUsed simultaneous games and proof 
theory. The reason for this terminology is that a ip-ip strategy corresponds to 
a minimax strategy in a 2-player game with ip — max and = min. Note 
however that when modelling a classical game as a generalised game all the 
quantifiers will be max, and so "tp-ip strategies are distinct in this sense from 
minimax strategies. 

Definition 14 {ip-(p strategy). Let Q be a 2-player game with quantifiers if G 
Sr^X and ip G SjiyY . A strategy a ^ X is called a ip-ip strategy for player 1 

qi{a,f{a)) e (p{Xx^.qi{x,f{x))) 
for all f d X Y with the property that for all x £ X , 

q2{x,f{x)) G tl){\y^ .q2{x,y)) 

Similarly b is a ip-(p strategy for player 2 iff q2{g{b),h) £ ilj{Xy^ .q2{g{y),y)) 
whenever qi{g{y),y) G cp{Xx^ .qi{x,y)). A ip-ip strategy profile is one whose 
components are both ip-Lp. 

The binary Berardi-Bezem-Coquand functional is the higher-order function 
§ e JrX X JrY Jr{X X Y) 

given by 

(£§^)(g) = (a, 6) 

where 

a = e{Xx^ .q{x,6{Xy^ .q{x,y)))) 
b^6{Xy''.q{e{Xx''.q{x,y)),y)) 

Notice that the type of ® is the same as the type of (g). Moreover when infinitely 
iterated both provide proof interpretations (in the modified reali zability inter- 



pretation of Heytin g arithmetic) of the axiom of countable choice ([Berardi et al 



1998LlBergeijl20Q2h a nd a certain equivalence, namely interdefinability over sys- 



tem T, is shown in (jPow ell 2012). However the relationship between the two 
functionals is not well understood, and only the product of selection functions 
has previously been linked to game theory. 

Theorem 6. Let Q be a 2-player game with single outcome space such and total 
single-valued quantifiers attained by selection functions s, d. Then the strategy 
profile 

{s®d){q) eX xY 

is a tp-ip strategy profile. 

Proof. Since ip is single-valued, the unique / with the given property is 

f[x) = = S{Xy^ .q{x,y)) 
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The first component in the strategy profile is 

a = e{Xx^ .q{x, bx)) 

We therefore have 

q{a,ba) = {Xx^ .q{x,bxj){e{Xx^ .q{x,bx))) G (p{Xx^ .q{x,bx)) 
as required. The proof for b is symmetric. □ 

In particular, in a 2-player classical game if a player has outcome function q 
then they have a minimax strategy given by (arg max ® arg min) (q) . 



8 Conclusions 



For sequential games, the proof of the existence of equilibria uses the product 
of selection functions and is constructive (theorem 2]) . Due to the importance 
of the product of selection functions, the constructive nature of the existence 
proof is an important part of the theory. Theorem [3] is similar to theorem |3] but 
is nonconstructive. 

Nash gave 2 diffe rent proofs o f his existence theorem, one using the Brouwer 
fixed point theorem (|Nashlll950a[) and the other using the Kakutani fixed point 
theorem, a weaker for m of the Kaku tani-Fan-Glicksberg theorem applicable only 
to Euclidean spaces (|Nashlll950bh . Of these, only the second appears to be 
amenable to generalising as we have done. The Brouwer, Kakutani and Nash 
theorems are all known to not be provable constructively but they all have 
equivalent approximation theorems tha t are provable constructively and ar e 
complete for the same complexity class ( Tanakal l201l[ iDaskalakis et al.l l2006l ) . 
The author plans to investigate the computation of abstract Nash equilibria in 
subsequent papers. 

It should be noted that theorem^ like Nash's original theorem, has a simpler 
proof using the weaker Kakutani theorem. The reason for proving the stronger 
theorem [2] is that it can be used to prove a stronger result which also gener- 
alises Glicksberg's theorem (|Glicksbere]|l952l ). a result which generalises Nash's 
theorem for finite games to games whose strategy sets are compact topological 
spaces and whose outcome functions are continuous. 
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